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ABSTRACT 

In a concerted effort to head off a situation in 
which almost half of the nation's young adults may conceivably be 
judged as having restricted literacy skills, the Educational Testing 
Service (ETS) has made a major commitment of human and financial 
resources to the area of adult literacy. ETS is directing a team of 
researchers and measurement specialists in a number of simultaneous 
projects that focus on the needs of adults with restricted literacy 
skills. Programs includ>2 (1) a computer-based learning assessment 
system that will focus on the needs of adults with midlevel literacy 
skills; (2) the Workplace Literacy Assessment — a project to profile 
the literacy skills needed in the workplace by jobseekers; and (3) 
establishment of literacy requirements for the 40 highest-volume, 
fastest-growing jobs in the United States between now and the year 
2000. These projects will result in the development of learning 
progress scales in which teachers and learners can identify current 
positions and obtain guidance about what to do to move to a higher 
level. (RS) 
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Adult literacy: helping Americans with ^^^^ ^ ' 
^midlevel skills prepare for the high-level 
demands of tomorrow 



OAt first glance, the national 
statistics on adult literacy look 
impressive: 95 percent of 
America's young adults can 
^5 read well enough to acconi- 
JVJ plish simple, routine literacy 
tasks. But the situation is not 
quite so rosy when you consi- 
der that only half of them 
perform as well as the average 
elcventh-grade student. 
Predicted economic^ labor, and 
demographic changes indicate 
that by the year 2000, the 
literacy problem will be more 
severe, further dividing sociei> 
along socioeconomic lines and 
threatening U.S. competitive- 
ness in the world market. 

In a concerted effort to head 
off a situation in which almost 
half of the nation's young 
adults may conceivably be 
judged as having restricted 
literacy skillF, ETS has made a 
major commitment of human 
and financial resources to th'^' 
area of adult literacy. Senior 
Research Scientist Irwin 
Kirsch is directing a team of 
researchers and measurement 
specialists in a number of 
simultaneous projects that 
focus on the needs of adults 
with restricted literacy skills. 

**One consequence of our 
technologically advancing 
society is that literacy ha? 
become a sort of currency for 
granting rewards and giving 
people opportunities for 
personal advancement,** Kirsch 
says. "And, like any currency, 
literacy has been subject to 
inflationary pressures. It's not 
so much that Americans are 
becoming less literate, but that 
we keep raising the literacy 
standards we expect them to 
achieve." 
^ Indeed, tl. ) standards used to 

define literacy have changed 
^ dramatically over the years. 
Q> During World War I, people 
^ were considered literate if they 
^ could read as well as fourth- 
^ 0 In the 1960s, literacy 
£RJ (Refined as the ability to 
BBOsi he eighth-grade level, 
but by (he 1970sr educators 



were insisimg that a iwclfih- 
crade reading abihiv would be 
necessary to function as a 
coniribuiipg member of 
socieiv. 

Toda>, as America continues 
to^move from a manufacturing 
and industrial base to an 
information/service econom), 
a growing percentage of jobs 
will require literacy skills 
usually associated with some 
form of postsecondar> educa- 
tion. Although the U.S. Bureau 
of Labor Statistics estimates 
that there will continue to be 
large numbers of low-skill jobs 
m the areas of health, custo* 
dial, and construction services, 
individuals who hope to escape 
from the low wages and 
intermittent unemployment of 
these jobs will need higher 
literacy skills. 



'•Hv)wc\cr.'* KiisLh poinis 
out. It's Nvn esiinialal that 
75 percent )j the work lorLC 
tor the \cjr 2()()() is .ilroj(l\ 
working. Not only do wc need 
to address educational issues 
as the) Will affect tomorrow \ 
workplace, but we must also 
focus on issues of retraining 
and reeducation as they will 
affect the work force of today." 

Kirsch is genuinely con- 
cerned for the society at large. 
''Unless we are better able to 
prov ide all segments of our 
society with increased literacy 
skills, the very nature of our 
society will change. Within 10 
years, we will be a less literate 
society: there will be greater 
gaps between those who ha\e 
the skills they need and those 
who don't, h is imperaine that 
we find efficient and effective 



ways to teach literacy skills to 
more people, su that they, in 
turn, will ha\e access to bettei 
jobs and be able to participaie 
more fully in our society." 

The first priority for Kirsch 
and his team is to develop, by 
the summer of 1 992. an 
operai ^nal prototype of a 
computer-based learning and 
assessment system in adult 
literacy that will focus on the 
needs of adults with midlevel 
reading skills. 

*ln lerm^ of content, the 
literacy programs that are 
currently available fall at the 
extreme ends of the spectrum," 
notes ETS Vice President C. 
\ icior Bunderson. **Ai one 
end. you have a very pragmatic 
batch ol programs designed to 
help the user accomplish 
soniclhmg quite specific, such 
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as filling out a job apphcanon 
or developing a resume. At the 
other end of the spectrum^ you 
find programs that are struc- 
tured in grade levels^ almost 
like course work, with no real 
conneeiion to the pragmatic 
reading tasks adults must 
process. In the long term 
neither of these approaches 
will help ease the bulk of the 
literacy problem in this 
country." 

In contrast to these pro- 
grams, Bunderson says, the 
ETS approach involves 
detailed analyses of the 
cognitive processes required to 
perform everyday tasks, then 
linking those tasks to points on 
a scale that represents the 
different levels of literacy. 
Levels of literacy 
The initial step toward under- 
standing the levels of literacy 
was taken in 1985, when the 
ETS-adminisiered National 
Assessment of Educational 
Progress (NAEP) conducted a 
national survey of the literacy 
skills of young .adults. In 
reporting the results of that 
assessment to the nation, 
NAEP profiled skills on ^hree 
scales representing very 
distinct and important aspects 
of literacy: 

Prose literacy — the 
knowledge and skills needed lo 
understand and use informa- 
tion from texts that include 
editorials, news stories, and 
poems; 

V Document literacy — the 
knowledge and skills required 
to locate and use information 
contained in job applications, 
forms, maps, bus schedules, 
tables, and indexes; and 
fc> Quantitative literacy — the 
knowledge and skills needed to 
apply arithmetic operations to 
information embedded in 
printed materials, such as 
balancing a checkbook, 
figuring out a tip, completing 
an order form, or determining 
the amount of interest from a 
loan advertisement. 

A survey instrument 
consisting of a large pool of 
"simulation tasks/* represent- 
ing the diverse types of literacy 
activitks that people encounter 
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at work, at home, and in their 
communities, was developed 
and administered to a nation- 
ally representative sample of 
people between the ages of 21 
and 25. 

Kirsch and his team spent a 
full year studying the NAEP 
literacy data. By conducting 
detailed reviews of the 
cognitive processes that 
underiie each task, the re- 
searchers were able to identify 
a number of variables that 
appeared to contribute to the 
kinds of errors demonstrated 
by survey panicipants. 

^'Basically, we've been 
trying to understand whaf 
contributes to the difficulty 
along each of the scales/' 
Kirsch explains. "The diffi- 
culty of pnnted materials is not 
determined just by their 
structure but also by what the 
reader has to do with them. 
People with high-level literacy 
skills employ a variety of 
different reading strategies for 
different purposes. People who 
are reading at the fourth- to 
eleventh-grade levels have the 
basic literacy skills, but they 
lack the array of strategies 
necessary to deal with print at 



varying levels of difficult). Sj 
we studied the kinds of errors 
people make when they 
attempt the tasks, and we're 
using that data to develop 
instructional routines." 
DO' partnership 
The ETS literacy team is also 
working with the U.S. Depa.l- 
nienl of Labor on a project to 
profile the literacy skills of 
people participating in Job 
Training Partnership Act 
( J fPA) programs, as well as 
individuals being served by 
Employment Service (ES) and 
Unemployment Insurance (UI) 
programs. The project is called 
the Workplace Lif^racy 
Assessment and marks the first 
effort to create a profile of the 
on-the-job literacy skills of the 
three target populations. 

The project will be carried 
out in two phases. Dunng the 
first nhase, the NAEP literacy 
survey instrument will be 
extended and administered to a 
random sample of 8,000 
individuals from the three 
populations. The second phase 
will involve expanding the 
item pool to produce paper- 
and-pencil and, later, compu- 
terized tests to diagnose 
individual strengths and 
weaknesses. 

ETS*s adult-literacy efforts 
and the DOL project have 
formed a mutually beneficial 
relationship. The research 
already completed at ETS will 
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make It possible to bin 
appropi late assessment 
measures tor ihe D(JL pop. 
lions, and die *isscssmcnl ol 
ihc DOL target groups uill 
prowic TiTS with an opportu- 
nit> U) develop a batter\ ol 
new simuiatio'i tasks with 
known properties and to 
calibrate the nevv tasks to the 
three existing literacy scale^ 
In addition, the analy.ses ol I .e 
errors typically made on tlie 
DOL simuk Ion tasks will 
provide new and important 
information for the develop- 
ment of instructional materials 
for ETS*s learning and 
assessment system. 

The Department of Labor 
expects to use the resuhs of the 
Workplace Literacy Assess- 
ment to guide the direction of 
futi'-e basic education, skills 
training, and other labor 
programs under the aegis of 
the Employment and Training 
Administration, and the 
measurement instruments 
produced for the second phase 
of the project will be used as 
diagnostic tools to help DOL's 
client populations. 
Literacy on the job 
In yel another project, literacy 
team members Judith Norback 
and Michael Rosenfeld are 
attempting to establish the 
literacy requirements for a 
select group of jobs typically 
held by people with midlevel 
reading skills. 

Norback and Rosenfeld 
started by identifying the 40 
highest-volume, fastest- 
growing jobs in the U.S. 
between now and the year 
2000. In the initial study, they 
are studying the literacy 
demands of five entry-level 
positions (secretary, word 
processor, data-processing 
equipi.^ent repairer, food- 
preparation worker, and 
nurse's aide) and two higher- 
level jobs (cook and executive 



secretary). They are currently 
conducting iniervicwa with 
approximatel> 200er.»plo>ee>» 
in industnai,govemmc.r and 
health-care settings and 
colltcling samples of on-the- 
job reading materials represen- 
tative of" the three literacy 
bcales (prose, document, and 
quantitative) typically used by 
these individuals. 

Later in the study, a larger 
group of individuals workmg 
in the five positions will 
evaluate literacy tasks and 
materials that are representa- 
tive of the demands of the five 
positions. A generic job 
description for each position, 
as well as a description of each 
job's literacy requirements, 
will result from the study. 

^'Actually, we're doing 
research to see if the job- 
analysis methodology ETS 
developed 15 years ago can be 
adapted to document the 
literacy materials and tasks 
required in today's jobs," 
explains Norback, "This is 
particularly exciting for me, 
because the work we* re doing 
here at ETS will eventually 
evolve into learning experi- 
ences for people in the 
workplace and in high schools 
O vocational schools. If we 
^|^(^ establish the different 
Mfflifflifflfffi'Hiin icy levels required to 
perform successfully as a 



Nccretary and an executive 
secretary, lor example, and 
then link them to the profi- 
ciency scales, we could incor- 
porate that information into the 
computenzed-adaptive 
learning and assessment 
system.'* 

individuals working as 
secretaries, Norbacl. says, 
N^ouid be able to sit down and 
take a computerized test to find 
out if they have the skills 
required for the next logical " 
career step in their field, ff 
they found they were weak in 
certain areas, the system would 
offer them instructional units 
Jesigned to develop those 
particular skills. 

"Ultimately, we hope that 
when people look at these 
proficie.icy .scales and recog- 
nize the real-life tasks from 
their own \/ork, they will be 
motivated h> liicir relevance. 
Teachers or supervisors will be 
able to identify the appropriate 
level of literacy required to 
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complete such tasks.'' sa\s 
Bunderson. "Employers or 
trainmg agencies could then 
iise this inforniaiion to 
organize their job-training 
curriculum or retrainmg efforts 
to address ver\' specific 
weaknesses bv identifiable 
tasks. Based on the indi\ id- 
ual's performance on the 
assessment, the employer 
would know precisely where to 
have that individual begin the 
training program. This wouid 
enable employers to provide 
training more on target than 
ever before." 

"The traditional, piecemeal 
approaches to adult literacy 
just haven't panned out," 
Kirsch c^dds. "We need a 
system that will teach people 
the full range of literacy skills 
that will be transportable from 
one environment to another. 
There will be serious conse- 
quences for our society if 
something isn't done/* 

Bunderson agrees that the 
adult literacy project at ETS 
will result in new type«s of 
products and services that vwll 
help make a significant impact 
on a major social problem. 
"Beyond this,*' he adds, "'the 
project IS developing new 
concepts, procedures, and 
capabilities for FTS lo use in a 



\ariety of programs. Measure- 
ment scales like the NAEP 
literacy scales c?n be a starting 
point for developing learning 
progress scales. Learners and 
teachers can not only identify 
current positions, but can be 
provided with guidance about 
what to do to move to a higher 
level. 

"fn contrast to aptitude 
testing," he adds, "the new 
scales do not assume that 
capability is a fixed quality, not 
easily changed. The new 
measurement models assume 
that what is measured is 
changeable through instruc- 
tion, practice, and feedback. 
The new family of Learning 
Progress Systems can make 
learning as effective and 
enjoyable as possible," 

For more information, 
contact the Editor, ETS 
Developments, 16-0, ETS, 
Rosedale Road, Princeton, NJ 
08541-0001. 



